ABSTRACT
OBJECTIVES: Many prediction models for coronavirus disease 2019 (COVID-19) have been developed. External validation is mandatory before implementation in the intensive care unit (ICU). We selected and validated prognostic models in the Euregio Intensive Care COVID (EICC) cohort. STUDY DESIGN AND SETTING: In this multinational cohort study, routine data from COVID-19 patients admitted to ICUs within the Euregio Meuse-Rhine were collected from March to August 2020. COVID-19 models were selected based on model type, predictors, outcomes, and reporting. Furthermore, general ICU scores were assessed. Discrimination was assessed by area under the receiver operating characteristic curves (AUCs) and calibration by calibration-in-the-large and calibration plots. A random-effects meta-analysis was used to pool results. RESULTS: 551 patients were admitted. Mean age was 65.4 ± 11.2 years, 29% were female, and ICU mortality was 36%. Nine out of 238 published models were externally validated. Pooled AUCs were between 0.53 and 0.70 and calibration-in-the-large between -9% and 6%. Calibration plots showed generally poor but, for the 4C Mortality score and Spanish Society of Infectious Diseases and Clinical Microbiology (SEIMC) score, moderate calibration. CONCLUSION: Of the nine prognostic models that were externally validated in the EICC cohort, only two showed reasonable discrimination and moderate calibration. For future pandemics, better models based on routine data are needed to support admission decision-making.
ABSTRACT
OBJECTIVES: To investigate healthcare system-driven variation in general characteristics, interventions, and outcomes in coronavirus disease 2019 (COVID-19) patients admitted to the ICU within one Western European region across three countries. DESIGN: Multicenter observational cohort study. SETTING: Seven ICUs in the Euregio Meuse-Rhine, one region across Belgium, The Netherlands, and Germany. PATIENTS: Consecutive COVID-19 patients supported in the ICU during the first pandemic wave. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Baseline demographic and clinical characteristics, laboratory values, and outcome data were retrieved after ethical approval and data-sharing agreements. Descriptive statistics were performed to investigate country-related practice variation. From March 2, 2020, to August 12, 2020, 551 patients were admitted. Mean age was 65.4 ± 11.2 years, and 29% were female. At admission, Acute Physiology and Chronic Health Evaluation II scores were 15.0 ± 5.5, 16.8 ± 5.5, and 15.8 ± 5.3 (p = 0.002), and Sequential Organ Failure Assessment scores were 4.4 ± 2.7, 7.4 ± 2.2, and 7.7 ± 3.2 (p < 0.001) in the Belgian, Dutch, and German parts of Euregio, respectively. The ICU mortality rate was 22%, 42%, and 44%, respectively (p < 0.001). Large differences were observed in the frequency of organ support, antimicrobial/inflammatory therapy application, and ICU capacity. Mixed-multivariable logistic regression analyses showed that differences in ICU mortality were independent of age, sex, disease severity, comorbidities, support strategies, therapies, and complications. CONCLUSIONS: COVID-19 patients admitted to ICUs within one region, the Euregio Meuse-Rhine, differed significantly in general characteristics, applied interventions, and outcomes despite presumed genetic and socioeconomic background, admission diagnosis, access to international literature, and data collection are similar. Variances in healthcare systems' organization, particularly ICU capacity and admission criteria, combined with a rapidly spreading pandemic might be important drivers for the observed differences. Heterogeneity between patient groups but also healthcare systems should be presumed to interfere with outcomes in coronavirus disease 2019.